Bayesian analysis of variable-order, reversible Markov chains
نویسندگان
چکیده
منابع مشابه
Bayesian Nonparametric Analysis of Reversible Markov Chains
We introduce a three-parameter random walk with reinforcement, called the (θ,α,β) scheme, which generalizes the linearly edge reinforced random walk to uncountable spaces. The parameter β smoothly tunes the (θ,α,β) scheme between this edge reinforced random walk and the classical exchangeable two-parameter Hoppe urn scheme, while the parameters α and θ modulate how many states are typically vis...
متن کاملBayesian analysis for reversible Markov chains
• A submitted manuscript is the author's version of the article upon submission and before peer-review. There can be important differences between the submitted version and the official published version of record. People interested in the research are advised to contact the author for the final version of the publication, or visit the DOI to the publisher's website. • The final author version ...
متن کاملBayesian variable order Markov models
We present a simple, effective generalisation of variable order Markov models to full online Bayesian estimation. The mechanism used is close to that employed in context tree weighting. The main contribution is the addition of a prior, conditioned on context, on the Markov order. The resulting construction uses a simple recursion and can be updated efficiently. This allows the model to make pre...
متن کاملSymmetry Analysis of Reversible Markov Chains
We show how to use subgroups of the symmetry group of a reversible Markov chain to give useful bounds on eigenvalues and their multiplicity. We supplement classical representation theoretic tools involving a group commuting with a self-adjoint operator with criteria for an eigenvector to descend to an orbit graph. As examples, we show that the Metropolis construction can dominate a max-degree c...
متن کاملweak-reversible Markov chains
The theory of L-spectral gaps for reversible Markov chains has been studied by many authors. In this paper we consider positive recurrent general state space Markov chains with stationary transition probabilities. Replacing the assumption of reversibility by a less strong one, we still obtain a simple necessary and sufficient condition for the spectral gap property of the associated Markov oper...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: The Annals of Statistics
سال: 2011
ISSN: 0090-5364
DOI: 10.1214/10-aos857